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IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD 
BACKGROUND OF THE INVENTION 
This application is a National Phase Application of 
International Application No. PCT/JP2 006/302518 , filed 
5 February 14, 2006, which claims the benefit under 35 U.S.C. 
119 (a-e) of Japanese Application No. 2005-047400 filed 
February 23, 2005, which is herein incorporated by reference. 

1. Field of the Invention 

The present invention relates to an image processing 
10 technology in a graphics processor or the like. 

2. Description of the Related Art 

With the remarkable development of computer graphics 
technology and image processing technology used in computer 
gaming, digital broadcast etc, in recent years, more detailed 

15 display of three-dimensional graphics etc. has become 

possible. In three-dimensional graphics processing, a three- 
dimensional object having three-dimensional coordinate data 
is projected onto a two-dimensional screen for display on a 
display or the like. 

20 Normally, a three-dimensional object is modeled using a 

combination of polygons (e.g., triangles). In projecting a 
three-dimensional object onto a two-dimensional screen, 
rasterization is performed wherein values like luminance of 
pixels inside the polygons are calculated by referring to 

25 data on vertices of the polygons. 

In rasterization, a linear interpolation method called 
Digital Differential Analyzer (DDA) is used. DDA allows 
obtaining gradient between data for a vertex of a polygon and 
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data for another vertex of the polygon in the direction of a 
side of the polygon. The gradient thus obtained is used to 
compute data for the polygon sides. Subsequently, pixels 
inside the polygons are generated by computing the gradient 
5 in the raster-scan direction. 

Patent document 1 discloses a technology for improving 
rendering speed whereby a pixel group comprising a plurality 
of pixels included in a predefined rectangular area is dealt 
with as a unit of processing and a set of pixel groups are 

10 transmitted to a processing block in the subsequent stage. 

Patent document 2 teaches an improvement over the 
technology described in patent document 1. Processing 
efficiency is improved by merging multiple pixel groups into 
a single pixel group before transmitting the same to a 

15 processing block in the subsequent stage. 

[patent document 1]JP 2000-338959 A 
[patent document 2]JP 2003-123082 A 

With improvements in the performance of image 
processing apparatuses for processing three-dimensional 

20 computer graphics in recent years, the size of a polygon 
forming a three-dimensional object tends to be smaller in 
order to render a more detailed three-dimensional object. 
Consequently, pixel groups including only a limited number of 
valid pixels are increasingly more likely to be generated. 

25 In this background, more efficient merge of rectangular areas 
(pixel groups) is called for. 



SUMMARY OF THE INVENTION 
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A general purpose of the present invention in this 
background is to provide an image processing apparatus 
capable of achieving efficient image processing. 

An embodiment of the present invention pertains to an 
5 image processing technology which renders, in a screen 

coordinate system, unit figures each constituting the surface 
of a three-dimensional object to be rendered. In this image 
processing technology, a unit figure is divided into multiple 
unit areas on a screen coordinate system so that the unit 
10 areas are output. Each of the output unit areas is divided 
into multiple subareas . Selected ones of the multiple 
subareas are discarded according to a predetermined rule. 
Rendering is performed on subareas that survived the 
discarding process . 
15 BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments will now be described, by way of example 
only, with reference to the accompanying drawings which are 
meant to be exemplary, not limiting, and wherein like 
elements are numbered alike in several Figures, in which: 
20 Fig. 1 shows the structure of an image processing 

apparatus according to a first embodiment. 

Fig. 2 shows how pixels are generated by a rasterizing 

unit . 

Figs. 3A-3C show how multiple stamps are merged under 
25 different conditions. 

Fig. 4 shows how a stamp is divided into quads. 
Fig. 5 is a flowchart showing how stamps are merged in 
a merger according to the first embodiment. 
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Fig. 6 shows how stamps are merged according to the 
flowchart shown in Fig. 5. 

Fig. 7 shows the structure of an area writer. 

Fig. 8 shows how quads are distributed by the area 
5 writer to output units. 

Figs. 9A-9C show how the area writer writes a merged 
stamp into a cache memory. 

Fig. 10 shows another example of merging stamps. 

Fig. 11 shows how the quads are distributed to the 
10 output units in the area writer. 

Figs. 12A-12C show how the area writer writes merged 
stamps shown in Fig. 10 into the cache memory. 

Fig. 13 shows how merge proceeds according to a second 
embodiment when stamps having different stamp addresses are 
15 input in succession. 

Fig. 14 shows how the quads are distributed to the 
output units in the area writer. 

Figs. 15A-15C show how the area writer writes a merged 
stamp of Fig. 13 into the cache memory 50. 

20 

DETAILED DESCRIPTION OF THE INVENTION 

The invention will now be described based on preferred 
embodiments which do not intend to limit the scope of the 
25 present invention but exemplify the invention. All of the 
features and the combinations thereof described in the 
embodiment are not necessarily essential to the invention. 

Before giving a specific description of embodiments, a 
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summary of the embodiments will be given. 

An embodiment of the present invention relates to an 
image processing apparatus which renders, in a screen 
coordinate system, unit figures each constituting the surface 
5 of a three-dimensional object to be rendered, comprises a 

rasterizing unit which divides a unit figure into a plurality 
of unit areas on the screen coordinate system and outputs the 
unit areas; an area divider which divides each of the unit 
areas output from the rasterizing unit into a plurality of 

10 subareas; an area discarder which discards as necessary a 
subarea obtained by the division by the area divider 
according to a predetermined rule; and an area writer which 
writes a subarea that survived the discarding process by the 
area discarder into a memory. 

15 According to this embodiment, the number of subareas 

transmitted to a subsequent stage can be reduced for 
efficient rendering, by dividing each of the unit areas into 
the subareas and discarding unnecessary subareas . A unit 
figure is a polygon or a curved surface patch, by way of 

20 examples. 

The area writer may re -merge subareas that survived the 
discarding process and writes merged areas obtained by re- 
merge in the memory. 

Of the subareas that survived the discarding process by 
25 the area discarder, the area writer may merge subareas 

derived from unit areas having the same coordinates in the 
screen coordinate system before the division. 

In this case, it is ensured that the subareas included 
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in a merged area obtained as a result of re-merge are all 
derived from the unit areas at the same position. This 
eliminates the need to refer to the coordinate of the unit 
area originating each subarea, in writing data related to the 
5 merged area into the memory. 

The merged area may have the same size as the unit area. 
In this case, output data from the rasterizing unit is of the 
same size as output data from the area writer. By ensuring 
that a unit throughput in the rasterizing unit is equal to a 

10 unit throughput in writing into the memory, hardware and 
software can be designed flexibly and compatibility with 
existing systems is enhanced. 

The size of the subarea may correspond to a unit 
throughput in which the area writer writes the subareas into 

15 the memory at a time. 

The area writer may refer to information indicating the 
relative position of a subarea in the unit area to which the 
subarea belonged before the division and write the subarea in 
an address in the memory corresponding to the information. 

2 0 The unit area may be a rectangular area, the 

rasterizing unit may divide a rendering area so that each of 
the plurality of unit areas includes a pixel group, the pixel 
number in the vertical direction and the pixel number in the 
horizontal direction of a pixel group in a given unit area 

25 being identical with the corresponding numbers of a pixel 

group in another unit area, and the area divider may divide 
the unit area including the pixel group into a plurality of 
subareas each including a small pixel group, the pixel number 
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in the vertical direction and the pixel number in the 
horizontal direction of a pixel group in a given unit area 
being identical with the corresponding numbers of a pixel 
group in another unit area. 
5 Of the plurality of subareas obtained by the division 

by the area divider, the area discarder may discard a subarea 
that does not include any valid pixels. The term "valid 
pixel" means a pixel which represents an area embraced by a 
unit figure whose luminance value, and/or fog value etc. had 

10 been generated by the rasterizing unit. 

By discarding subareas that do not include any valid 
pixels, frequency of treating invalid pixels in a processing 
unit in a subsequent stage is reduced so that efficient 
rendering is achieved. 

15 Of the subareas that survived the discarding process by 

the area discarder, the area writer may re-merge subareas 
which do not include valid pixels at identical coordinates in 
the screen coordinate system and may write subareas into the 
memory in units of merged areas obtained by re-merge. 

20 By eliminating from re-merge those subareas that have 

valid pixels at identical coordinate in the screen coordinate 
system, loss of information due to overlapping of valid 
pixels is successfully prevented. 

Of the subareas that survived the discarding process by 

25 the area discarder, the area writer may merge subareas 

derived from unit areas having the same coordinates in the 
screen coordinate system before the division. 

In this case, it is ensured that the subareas included 
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in a merged area obtained as a result of re-merge are all 
derived from the unit areas at the same position. This 
eliminates the need to refer to the coordinate position of 
the unit area originating each subarea, in writing data 
5 related to the merged area into the memory. 

The area writer may refer to information indicating the 
relative position of a subarea in the unit area to which the 
subarea belonged before the division so as to write the 
subarea in an address in the memory corresponding to the 
10 information. 

Even if the information indicating the relative 
position of the subarea changes as a result of re-merge, the 
subarea can be written in a proper address by referring to 
the information indicating the relative position of the 
15 subarea in the originating unit area. 

The area writer may comprise a memory access unit which 
writes pixels included in the subarea into the memory in 
parallel . 

Another embodiment of the present invention relates to 
2 0 an image processing method. The image processing method 

which renders, in a screen coordinate system, unit figures 
each constituting the surface of a three-dimensional object 
to be rendered, comprises: rasterizing by dividing a unit 
figure into a plurality of unit areas on the screen 
25 coordinate system and outputting the unit areas; dividing 
each of the unit areas output from the rasterizing into a 
plurality of subareas; discarding as necessary a subarea 
obtained by dividing the unit area according to a 
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predetermined rule; and writing a subarea that survived the 
discarding into a memory. 

The rasterizing may divide a rendering area so that 
each of the plurality of unit areas includes a pixel group, 
5 the pixel number in the vertical direction and the pixel 
number in the horizontal direction of a pixel group in a 
given unit area being identical with the corresponding 
numbers of a pixel group in another unit area, and the unit 
area dividing may divide the unit area including the pixel 

10 group into a plurality of subareas each including a small 

pixel group, the pixel number in the vertical direction and 
the pixel number in the horizontal direction of a pixel group 
in a given subarea being identical with the corresponding 
numbers of a pixel group in another subarea . 

15 Of the plurality of subareas obtained by the division, 

the discarding may discard a subarea that does not include 
any valid pixels. 

Still another embodiment of the present invention 
relates to a rendering method. The rendering method which 

20 renders, in a screen coordinate system, unit figures each 

constituting the surface of a three-dimensional object to be 
rendered, comprises: dividing a unit figure into a plurality 
of unit areas on the screen coordinate system and outputting 
the unit areas; and generating merged areas by retrieving, 

25 from a plurality of subareas constituting each of the unit 
areas output from the dividing, subareas that include valid 
pixels . 

Another rendering method which renders, in a screen 
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coordinate system, unit figure each constituting the surface 
of a three-dimensional object to be rendered, comprises: 
dividing a unit figure into a plurality of unit areas on the 
screen coordinate system and outputting the unit areas; and 
5 writing subareas , of a plurality of subareas constituting 

each of the unit areas output from the dividing, that include 
valid pixels into a memory in parallel. 

Yet another embodiment of the present invention relates 
to a computer program product. The computer program product 

10 which renders, in a screen coordinate system, unit figures 
each constituting the surface of a three-dimensional object 
to be rendered, comprises: a dividing module which causes a 
computer to divide a unit figure into a plurality of unit 
areas on the screen coordinate system and outputting the unit 

15 areas; and a merging module which causes a computer to 

retrieve, from a plurality of subareas constituting each of 
the unit areas output from the dividing, subareas that 
include valid pixels so as to generate merged areas. 

Another computer program product which renders, in a 

20 screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered, 
comprises: a dividing module which causes a computer to 
divide a unit figure into a plurality of unit areas on the 
screen coordinate system and outputting the unit areas; and a 

25 writing module which causes a computer to write subareas, of 
a plurality of subareas constituting each of the unit areas 
output from the dividing, that include valid pixels into a 
memory in parallel. 
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Still another embodiment of the present invention 
relates to an image processing apparatus which renders, in a 
screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered. The 
5 image processing apparatus comprises: a rasterizing unit 

which divides a rendering area corresponding to a screen into 
multiple unit areas, while a unit figure is projected onto a 
screen coordinate system, and subjects a second and 
subsequent unit figures to a similar process so as to 

10 sequentially output a plurality of unit areas constituting 
each unit figure; an area divider which divides each of the 
unit areas sequentially output from the rasterizing unit into 
multiple subareas ; an area discarder which discards as 
necessary a subarea obtained by the division by the area 

15 divider according to a predetermined rule; and an area 

writer which writes a subarea that survived the discarding 
process in a memory. 

Yet another embodiment of the present invention relates 
to an image processing method which renders, in a screen 

20 coordinate system, unit figures each constituting the surface 
of a three-dimensional object to be rendered. The image 
processing method comprises: rasterizing by dividing a 
rendering area corresponding to a screen into multiple 
congruent unit areas, while a first unit figure is projected 

25 onto a screen coordinate system, and subjecting a second and 
subsequent unit figures to a similar process so as to 
sequentially output a plurality of unit areas constituting 
each unit figure; dividing each of the unit areas 
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sequentially output into multiple subareas; discarding as 
necessary a subarea obtained by the dividing the unit area 
according to a predetermined rule; and writing a subarea that 
survived the discarding in a memory. 
5 Still another embodiment of the present invention 

relates to a computer program product. The computer program, 
adapted to an image processing apparatus which renders, in a 
screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered, 

10 comprises: rasterizing by causing a computer to divide a 

rendering area corresponding to a screen into multiple unit 
areas, while a first unit figure is projected onto a screen 
coordinate system, and to subject a second and subsequent 
unit figures to a similar process so as to sequentially 

15 generate a plurality of unit areas constituting each unit 
figure; and dividing each of the unit areas sequentially 
generated in the rasterizing into multiple subareas; 
discarding as necessary a subarea obtained by the dividing 
according to a predetermined rule; and writing a subarea that 

2 0 survived the discarding in a memory. 

Optional combinations of the aforementioned 
constituting elements, and implementations of the invention 
in the form of methods, apparatuses, systems programs may 
also be practiced as additional modes of the present 

2 5 invent ion . 

Several modes of the present invention will be 
described in detail based upon embodiments. 
(First embodiment) 
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Fig. 1 shows the structure of an image processing 
apparatus according to a first embodiment. An image 
processing apparatus 1000 performs image processing such as 
three-dimensional computer graphics processing. The image 
5 processing apparatus 1000 projects a unit figure (or unit 
graphic form) constituting the surface of an object to be 
rendered onto a rendering area in a screen coordinate system 
and generates pixels so as to render the object, which is 
ultimately displayed on a display. 

10 The information processing apparatus 1000 comprises a 

graphics processor 200, a main processor 300, a main memory 
400 and a graphics memory 120. The blocks are connected to 
each other via a bus 500. 

The information processing apparatus 1000 is connected 

15 to a display apparatus (not shown) which outputs images and 
graphics generated by the image processing apparatus 1000. 
The elements illustrated in Fig. 1 and subsequent drawings as 
functional blocks executing respective processes are 
implemented by hardware including a CPU, a memory and an LSI 

20 and by software including a program provided with reservation 
and management functions and loaded into the memory. 
Therefore, it will be obvious to those skilled in the art 
that the function blocks may be implemented by a variety of 
non-limiting manners including hardware only, software only 

25 or a combination of both. 

The main processor 300 performs an operation such as 
three-dimensional computer graphics modeling. The main 
memory 400 is a storage area primarily used by the main 
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processor 300. For example, modeling data obtained by- 
processing a task related to computer graphics in the main 
processor 300 is temporarily stored in the main memory 400. 

The graphics memory 120 is a memory area dedicated to 
5 graphic -related data used and managed by the graphics 

processor 200. In addition to a frame buffer and a z buffer 
for storing image frame data, the graphics memory 12 0 further 
comprises areas respectively corresponding to vertex data, 
texture data and a color look-up table, which are basic data 

10 referred to when rendering image frame data. 

The graphics processor 200 is a block dedicated to the 
execution of an image. The graphics processor 200 performs a 
series of steps of rendering in which it reads from the main 
memory 400 three-dimensional modeling data generated by the 

15 main processor 300 and generates image frame data by 

performing coordinate transform, hidden surface elimination, 
shading etc . 

The graphics processor 200 includes a rasterizer 100, a 
memory interface unit 110 and a display controller 130. 

20 The rasterizer 100 reads three-dimensional modeling 

data from the main memory 400 so as to acquire vertex data of 
a primitive to be rendered. The rasterizer 100 performs a 
view transform in which a primitive in a three-dimensional 
space is transformed by projecting the primitive onto a 

25 screen coordinate system into a figure on a rendering plane. 

Further, the rasterizer 100 performs a rasterizing process in 
which the figure on the rendering plane is scanned in the 
horizontal direction of the rendering plane so as to 
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transform, row by row, the figure into quantized pixels. The 
rasterizer 100 decomposes the primitive into pixels and 
computes pixel information for each pixel. The pixel 
information includes RGB color values, an a value indicating 
5 transparency and a Z value indicating depth from a view point. 
The rasterizer 100 generates a pixel area of a 
predetermined size along the scan line and outputs the 
generated area to the memory interface unit 110. A pixel 
group output from the rasterizer 100 is temporarily stacked 
10 in a queue. The memory interface unit 110 sequentially 
writes pixel groups stacked in the queue to the graphics 
memory 12 0 . 

The memory interface 110 writes pixels in the graphics 
memory 120 or reads a frame buffer from the graphics memory 

15 120 in accordance with an instruction from the display 

controller 130. The display controller 130 outputs image 
data read from the graphics memory 120 to the display device. 

A detailed description will now be given of the 
structure and operation of the rasterizer 100. 

20 The rasterizer 100 includes a rasterizing unit 10, a 

merger 600 and a cache memory 50. 

The rasterizing unit 10 projects a triangle (a unit 
figure constituting the surface of an object rendered) onto a 
rendering area in a screen coordinate system. The 

25 rasterizing unit 10 divides the rendering area into multiple 
unit areas, generates pixels included in the unit areas and 
outputs pixel groups for each of the respective unit areas. 
The rasterizing unit 10 sequentially generates pixel groups 
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for the respective unit areas for output, repeating the step 
of generation for multiple unit figures (triangles) . 

Fig. 2 shows how pixels are generated by the 
rasterizing unit 10. Fig. 2 shows a part of a rendering area 
5 2000 in a screen coordinate system. A triangle 12 is a 
projection of a triangle (a unit figure constituting the 
surface of a three-dimensional object) onto a rendering area. 
The rasterizing unit 10 generates pixels inside the polygon 
by using the Digital Differential Analyze (DDA) method, based 
10 upon the coordinate values, colors, fog values and texture 
coordinates of three vertices 12a, 12b and 12c of the 
triangle 12. 

The rendering area is divided into multiple congruent 
unit areas 14 . 

15 The rasterizing unit 10 sequentially generates, for 

each unit area, pixel information (color, fog value etc.) for 
an area embraced by the triangle 12 and outputs the pixel 
information thus generated for the respective unit areas. 
Hereinafter, pixels for which pixel information is generated 

20 by the rasterizing unit 10 will be referred to as valid 
pixels . 

In this embodiment, the unit area 14 having a 
predetermined size includes 4x4 pixels. The 4x4 pixel group 
included in the unit area 14 will be referred to as a stamp 
25 STP. Each stamp STP maintains position information 

indicating the position of the associated unit area in the 
screen coordinate system. Hereinafter, the position 
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information of a stamp will be referred to as a stamp address 
ADDstp . 

The rasterizing unit 10 sequentially generates pixel 
information for each of the stamps STP and sequentially 
5 outputs stamps STP that include valid pixels to the merger 
600 . 

The merger 600 merges multiple stamps STP output from 
the rasterizing unit 10 and writes each of the stamps thus 
merged in the cache memory 50 in the subsequent stage. A 

10 stamp obtained by merging the multiple stamps STP in the 
merger 600 will be referred to as a final stamp STPf . The 
rasterizer 100 and the memory interface unit 110 inside the 
graphics processor exchange data with each other, using a 
stamp STP as a unit of processing. 

15 Merge performed in the merger 600 will be described. 

The merger 60 0 merges stamps having the identical stamp 
address ADDstp. 

Merge of the stamps is performed using the following 
two parameters. A first parameter represents the size of a 

20 unit referred to for determination as to whether merge is 
possible. A second parameter represents the size of a unit 
of actual merge. Figs. 3A-3C show how multiple stamps are 
merged under different conditions. A stamp STPm represents a 
merged stamp STPm obtained by merging two stamps STP1 and 

25 STP2. 

Hereinafter, a small pixel group comprising 2x2 pixels 
obtained by dividing a stamp will be referred to as a quad QD . 
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A quad that includes a valid pixel will be referred to as a 
valid quad. 

Fig. 3A shows merge performed when both two parameters 
are "pixels". The stamp STP1 and the stamp STP2 of Fig. 3A 
5 have the identical stamp address. These stamps STP do not 
include valid pixels that occur at identical positions. 
Therefore, upon pixel -by-pixel determination on overlapping 
(occurrence at identical positions) , the stamps will be 
merged without any problem. 

10 Fig. 3B shows merge performed when both two parameters 

are "quads (QD) " . In merge shown in Fig. 3B, a determination 
on occurrence at identical positions is made quad by quad. 
As a result, quads at top right of the stamp STP1 and the 
stamp STP2 are both valid and occur at identical positions. 

15 Therefore, the two stamps are not merged. The two stamps 
STP1 and STP2 are output unmodified. 

Fig. 3C shows merge according to this embodiment, 
wherein the first parameter is "pixel" and the second 
parameter is "quad (QD) " . In merge of Fig. 3C, a 

20 determination on occurrence at identical positions is made 
pixel by pixel. It is found that quads QD at top right of 
the stamp STP1 and the stamp STP2 are both valid and occur at 
identical positions, but valid pixels are not to found to 
overlap each other upon pixel -by-pixel determination. 

25 Additionally, the total number of valid quads is 4 or fewer. 
Thus, the stamps can be merged into a single stamp STPm. In 
the merged stamp STPm obtained as a result of quad-based 
merge, the position of a quad may be different from the 
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original position. This is addressed by relocation described 
later . 

As described, in the merge according to this embodiment 
shown in Fig. 3C, determination on occurrence at identical 
5 positions is made pixel by pixel and merge is performed quad 
by quad. As a result, efficiency in merging the stamp STP1 
and the stamp STP2 shown in Fig. 3C is equal to that of Fig. 
3A. When implemented in actual image processing, efficiency 
in merge is most superior in Fig. 3A, followed by Fig. 3C and 
10 Fig. 3B. 

Considering the cost required to implement an image 
processing apparatus for performing such merge, reduction in 
the size defined by the first parameter, which represents a 
unit referred to for determination of the possibility of 

15 merge, will only require a change in the unit of 

determination. As such, it does not result in a considerable 
increase in implementation cost. In contrast, reduction in 
the size defined by the second parameter, which represents a 
unit of actual merge, will require increased cost for 

20 implementing a unit for accessing a memory. Thus, in terms 
of implementation cost, the arrangement of Fig. 3B is most 
favorable, followed by Fig. 3C and Fig. 3A. 

Therefore, the method of merge according to this 
embodiment shown in Fig. 3C is superior in balance between 

25 efficiency in merge and implementation cost. A description 
will now be given of the structure of the merger 600 for 
achieving the merge according to this embodiment. 

The merger 600 includes an area divider 20, an area 
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discarder 30 and an area writer 40. 

The area divider 20 divides stamps STP sequentially 
output from the rasterizing unit 10 into multiple small 
congruent small pixel groups. In this embodiment, the area 
5 divider 20 divides a stamp STP of 4x4 pixels into congruent 
quads QD0-QD3 of 2x2 pixels and outputs the quads to the area 
discarder 30 in the subsequent stage. 

Fig. 4 shows how the stamp STP is divided into the 
quads QD0-QD3 . Each of the quads QD0-QD3 maintains position 

10 information indicating the relative position of the quads in 
the stamp, as a quad address ADDqd. It will be assumed that 
the quad addresses ADDqd are 00, 01, 10 and 11, starting with 
the top left quad and ending with the bottom right quad. In 
Fig. 4, the quad addresses are parenthesized. 

15 The area divider 20 outputs multiple pixels in units of 

quads QD to the area discarder 3 0 in the subsequent stage. 

The area discarder 3 0 retains selected quads QD 
selected from the multiple quads QD output from the area 
divider 20 and discards the rest. The area discarder 30 

20 outputs the quads QD that survived the discarding process to 
the area writer 40 in the subsequent stage. 

The area writer 40 writes the quads QD that survived 
the discarding process by the area discarder 30 to the cache 
memory 50. In this process, the quads that survived the 

25 discarding process by the area discarder 30 are re-merged and 
are used to reconstruct a stamp comprising 4x4 pixels. A 
stamp re-merged by the area writer 40 will be referred to as 
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a merged stamp STPm. 

The area writer 4 0 writes the merged stamp STPm output 
from the area discarder 3 0 in the cache memory 50 as a unit 
of processing. The merged stamp STPm written in the cache 
5 memory 50 is stacked in a queue. The memory interface 110 
sequentially writes the merged stamp STPm thus stacked into 
the graphics memory 120. Since the merged stamp STPm is not 
necessarily identical with the final stamp STPf, the area 
writer 40 relocates quads within the merged stamp STPm as 
10 described later. 

A detailed description of processes in the area divider 
20, the area discarder 30 and the aera writer 40 will now be 
given. 

Of those stamps STP sequentially output from the 
15 rasterizing unit 10, stamps that are targets of division by 

the area divider 20 will be referred to as source stamps STPs . 
A stamp which is obtained by sequentially and temporarily 
dividing source stamps STPs into quads, discarding 
unnecessary quads QD and re -merging stamps will be referred 
20 to as a merged stamp STPm. A stamp used in the process of 
merging source stamps STPs and maintained to be subject to 
merge will be referred to as a target stamp STPt . 

The merger 600 merges by sequentially writing quads QDs 
of the source stamps STPs into empty quads of the target 
25 stamp STPt. 

Fig. 5 is a flowchart showing how stamps STP are merged 
in the merger 600 according to this embodiment. 

Prior to starting a merge process, the area writer 40 
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initializes a target stamp STPt (S100) . 

The area writer 40 then initializes a variable j to 0 
(S102) . The variable j indicates the place, in the sequence 
of quads in the target stamp STPt, up to which the quad is 
5 valid. For example, if j=0, it indicates that no valid quad 
is written in the target stamp STPt. If j=4, it indicates 
that the target stamp STPt is filled with quads. 

The area divider 20 then acquires a source stamp STPs 
(S104) . Acquiring of a source stamp STPs is achieved by 
10 reading a stamp STP output from the rasterizing unit 10. 

The stamp address ADDstp of the target stamp STPt and 
that of the source stamp STPs are then compared (S106) . If 
the addresses of the two stamps differ (N in S106) , merge is 
not performed and the current target stamp STPt is output to 
15 the area writer 40 in the subsequent stage as a merged stamp 
STPm (S130) . The target stamp STPt is then initialized 
(S132) . In association with the initialization of the target 
stamp STPt, the variable j is set to 0 (S134) . Control is 
then returned to S108. 
20 If the addresses of the two stamps are identical (Y in 

S106) , the area divider 20 divides the source stamp STPs into 
four quads QDsO-QDs3 (S108) . 

A variable i is then initialized to 0 (S110) . The 
variable i indicates where, in the sequence of quads in the 
25 source stamp STPs subject to merge, the quad being processed 
is positioned. For example, if i = 0, the quad QDsO of the 
source stamp STPs is being processed. 

The area discarder 30 then determines whether the ith 
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quad QDsi of the source stamp STPs includes any valid pixel 
(S112) . If the quad QDsi does not include any valid pixel (N 
in S112) , the quad QDsi is discarded (S160) . The variable i 
is incremented by 1 to proceed to the next quad QDsi (S126) . 
5 If the quad QDsi includes a valid pixel (Y in S112) , 

the area writer 40 determines whether any of the valid pixels 
in the quad QDsi occurs at the identical position as a valid 
pixel of the target stamp STPt (S114) . The determination is 
made by determining whether the quad QDsi and the target 

10 stamp STPt include valid pixels at the same coordinate 
position in the screen coordinate system. 

If there are valid pixels occurring at identical 
positions (Y in S114), merge is not performed and the current 
target stamp STPt is output as a merge stamp STPm. The 

15 target stamp STPt is initialized and the variable j is 
returned to 0 (S140-S144) . Control then proceeds to the 
merge process described below (S116-S128) . 

If there are no valid pixels occurring at identical 
positions (N in S114), control also proceeds to the merge 

20 process described below (S116-S128) . 

The quad QDsi of the source stamp STPs is written in 
the jth quad QDtj of the target stamp STPt (S116) . The 
variable j is then incremented by 1 in order to shift the 
position of writing in the target stamp STPt (S118) . 

25 If j=4, it means that the quads QDs of the source 

stamps are merged with all quads QDtO-QDt3 of the target 
stamp STPt. Therefore, the current target stamp STPt is 
output as a merged stamp STPm (S150) . The target stamp STPt 
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is then initialized (S152) and the variable j is set to 0 
(S154) . The variable i is incremented by 1 to proceed to the 
next quad QDsi (S126) . 

If j#4, it means that there is an empty quad in the 
5 target stamp STPt . The target stamp STPt is maintained as it 
is and the variable i is incremented by 1 to proceed to the 
next quad QDsi (S126) . 

A determination on the variable i is made. If i=4 (Y 
in S128) , it means that merge is completed for all quads QDsi 
10 belonging to the source stamp STPs . Thereupon, the next 
source stamp STPs is acquired (S104) . 

If i#4, control is returned to S112 to proceed to the 
next quad QDsi. 

As described, the merger 600 merges if the stamp 
15 addresses of the target stamp STPt and that of the source 
stamp STPm are identical and if there are no valid pixels 
occurring at identical pixel positions. 

Fig. 6 shows how stamps are merged according to the 
flowchart shown in Fig. 5. We consider a case where the 
20 stamps STP1-STP4 are sequentially input to the area divider 
20. It will be assumed that the target stamp STPt is empty. 

The stamp STP1 will be the source stamp STPs and is 
divided by the area divider 20 into the four quads QDsO-QDs3. 
Since the quads QDsl-QDs3 do not include any valid pixel, 
25 they are discarded by the area discarder 30. 

Only the quad QDsO that survived the discarding process 
by the area discarder 30 is output to the area writer 40 and 
is written in the quad QDtO of the target stamp STPt. 



25 

Subsequently, the stamp STP2 will be the source stamp 
STPs and is divided by the area divider 20 into the four 
quads QDsO-QDs3. The area discarder 30 discards the quads 
QDsl-QDs3. The area writer 40 writes the quad QDsO in the 
5 quad QDtl of the target stamp STPt . 

A similar process is performed for the stamps STP2 and 
STP3 . Quads QDO having the quad address ADDqd of (00) and 
derived from the stamps STP1-STP4 are written in the quads 
QDt 0 -QDt3 of the target stamp STPt so as to generate a merged 
10 stamp STPm. 

The quads QDmO-QDm3 included in the merged stamp STPm 
maintain their quad addresses in the originating stamps STP1- 
STP4 as position information. The merged stamp STPm is 
output to the area writer 40 along with the position 
15 information. 

Fig. 7 shows the structure of the area writer 40. 

The area writer 40 includes a memory access unit 44 and 
a distributor 42. The memory access unit 44 is provided with 
output units 46a-46d for simultaneously writing four pixels 
20 included in a quad into the cache memory 50 in parallel. 

The distributor 42 distributes pixels constituting a 
quad QD to the output units 46a-46d. The top left pixel in a 
quad is distributed to the output unit 46a, the top right 
pixel to the output unit 46b, the bottom left pixel to the 
25 output unit 4 6c, and the bottom right pixel to the output 
unit 46d. 

By repeating the operation of simultaneously writing 
the four pixels into the cache memory 50 in parallel four 
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times in units of quads, the area writer 40 completes a 
process of writing into one merged stamp. 

Fig. 8 shows how the quads QDmO-QDm3 are distributed by 
the area writer 40 to the output units 46a-46d. The 
5 distributor 42 divides the merged stamp STPm into the four 
quads QDmO -QDm3 and sequentially distributes them to the 
output units 46a-46d at times Tl , T2 , T3 and T4 . 

At time Tl , the distributor 42 decomposes the quad QDmO 
into pixels and distributes the pixels to the four output 

10 units 46a-46d. Each output unit writes the pixel derived 

from decomposition into the cache memory 50. Subsequently, 
the quads QDml-QDm3 are decomposed into pixels at times T2 , 
T3 and T4 and are sequentially output. An output of a merged 
stamp STPm is produced in each unit period comprising times 

15 T1-T4. 

Figs. 9A-9C show how the area writer 40 writes the 
merged stamp STPm into the cache memory 50. Fig. 9A shows 
the cache memory 50; Fig. 9B shows how writing of quads by 
the area writer 40 proceeds; and Fig. 9C shows the final 
20 stamp STPf obtained upon completion of the writing. 

Since the merged stamp STPm is not necessarily 
identical with the final stamp STPf, the area writer 40 
relocates quads within the merged stamp STPm. 

The relocation is done as described below. 
25 At time Tl , the area writer 40 writes pixels included 

in the quad QDmO of the merged stamp STPm into the cache 
memory 50. The area writer 40 refers to the quad address 
ADDqd of the quad QDmO. Since the quad address ADDqd of the 
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quad QDmO is 00, the quad QDmO is written in an address 00 of 
the cache memory 50. 

Subsequently, the quad QDml is written at time T2 . 
Since the quad address of the quad QDml is also 00, the quad 
5 QDml is also written in the address 00 of the cache memory 50. 
Similarly, the quads QDm2 and QDm3 are written in the address 
00 at times T3 and T4 , respectively. 

As a result of all quads QDmO-QDm3 being written in the 
quad address ADDqd=00, the final stamp STPf in which the 
10 stamps STP1-STP4 of Fig. 6 are merged is generated. 

Fig. 10 shows how other stamps STP5-STP8 are merged. 
These stamps have identical stamp address and there are no 
valid pixels occurring at identical positions. 

First, the stamp STP5 is divided into four quads QDsO- 
15 QDs3 . Since only the quad QDsO includes a valid pixel, the 
quad QDsO is written in the quad QDtO of the target stamp 
STPt . The quads QDsl-QDs3 are discarded. 

Subsequently, the stamp STP6 will be the source stamp 
STPs so that the quads QDsO-QDs3 are subject to merge. As a 
20 result, the quads QDsO and QDs2 are written in the quads QDtl 
and QDt2 of the target stamp STpt , and the quads QDsl and 
QDs3 are discarded. 

Subsequently, the stamp STP7 will be the next source 
stamp STPs. The quad QDsO of the stamp STP7 is written in 
25 the quad QDt3 of the target stamp STpt. In this state, all 
quads in the target stamp STPt are valid so that the target 
stamp STPt is output as a merged stamp STPml . The target 
stamp STPt is then initialized. 
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Subsequently, the quad QDs2 of the source stamp STPs is 
written in the quad QDtO of a new target stamp STPt . The 
quads QDsl and QDs3 are discarded. 

The stamp STP8 will be the next source stamp. Since 
5 the quads QDsO-QDs3 all include valid pixels, the quads are 
written in the target stamp STPt without being discarded. 

The quads QDsO-QDs2 are written in the quads QDtl-QDt3 
of the target stamp STPt. In this state, all quads in the 
target stamp STPt are valid so that the target stamp STPt is 
10 output as a merged stamp STPm2 . The target stamp STPt is 
initialized again . 

The quad QDs3 of the source stamp STPs is written in 
the quad QDtO of the new target stamp STPt. The quad QDtO is 
then merged with quads from other source stamps STPs . The 
15 resultant target stamp is output as a merged stamp STPm3 . 

Fig. 11 shows how the quads QDmO-QDm3 are distributed 
to the output units 46a-46d in the area writer 40. 

The area writer 4 0 outputs the four quads QDm0-QDm3 
within the merged stamp STPml in the stated order at times Tl , 
20 T2, T3 and T4 , respectively. 

The distributor 42 of the area writer 40 distributes 
the four pixels included in each quad to the respective 
output units. The merged stamp STPml is written in a period 
comprising times T1-T4; the merged stamp STPm2 is written in 
25 a period comprising times T5-T8; and the merged stamp STPm3 
is written in a period comprising times T9-T12. 

The quads QDmO-QDm3 constituting each of the merged 
stamps STPml -STPm3 are output along with their addresses in 
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the originating stamps STP5-STP7. 

Figs. 12A-12C show how the area writer 40 writes the 
merged stamps STPml-STPm3 shown in Fig. 10 into the cache 
memory 50. At scheduled times, the area writer 40 refers to 
5 the addresses of the quads and writes the quads into the 
cache memory 50, relocating them. 

As a result, as shown in Fig. 12C, the final stamp STPf 
in which the stamps STP5-STP8 are merged is written in the 
cache memory 50. The memory interface unit 110 in the 
10 subsequent stage writes the final stamp STPf in the graphics 
memory 12 0. 

Thus, according to the image processing apparatus 1000 
of this embodiment, stamps, which are pixel groups 
representing units of processing output from the rasterizing 

15 unit 10, are divided into quads, which are smaller pixel 
groups. Unnecessary quads are discarded and quads that 
survived are merged. This can increase the number of valid 
pixels including in merged stamps obtained as a result of 
merge, resulting in an efficient rendering process. 

20 It will be particularly noted that the nature of a 

triangle strip is likely to generate a series of stamps which 
have an identical stamp address and in which valid pixels do 
not occur at identical positions. Accordingly, by merging a 
series of stamps efficiently, the number of valid pixels can 

25 be increased. 

The image processing apparatus according to this 
embodiment temporarily divides the stamps into quads for 
pixel -based determination as to whether merge is possible. 
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while the actual process of merge is quad-based. Accordingly, 
a favorable balance is achieved between implementation cost 
and processing efficiency. 

Further, the merged stamp STPm produced by the area 
5 discarder 30 is corrected by the area writer 40 into a final 
stamp STPf, which is ultimately output, through localized, 
intra-stamp relocation. Relocation performed by the area 
writer 40 is implemented by control of addresses in the cache 
memory 50 and relocation using cross bars. Addition or 
10 modification in hardware is required only in the memory 
access unit. The inventive approach can easily be 
implemented in conventional image processing apparatuses. 
( Second embodiment ) 

The second embodiment represents an improvement in 
15 which the stamp merge process described with reference to the 
first embodiment is expanded. In the first embodiment, quads 
are subject to merge only when the source stamp STPs has an 
identical stamp address as the target stamp STPm. The 
characteristic feature of the second embodiment is that merge 
20 of stamps having different stamp addresses is permitted. 

Hereinafter, merge wherein merge of stamps having different 
stamp addresses is permitted will be referred to as an 
expanded merge . 

Fig. 13 shows how merge proceeds when stamps having 
25 different stamp addresses are input in succession. Stamps 

STP10 - STP13 are sequentially input from the rasterizing unit 
10 to the area divider 20. It will be assumed that the stamp 
address ADDstp of the stamps STP10 and STP11 is 0001 and the 
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stamp address ADDstp of the stamps STP12 and STP13 is 0010. 
None of the valid pixels in the stamps STP1 0 - STP13 occurs at 
identical positions . 

The area divider 20 uses the stamp STP10 as the source 
5 stamp STPs and divides the stamp STP10 into quads QDsO-QDs3. 
The quad QDsO is written in the quad QDtO of the target stamp 
STPt, and the quads QDsl-QDs3 are discarded. 

Subsequently, the stamp STP11 will be the source stamp 
STPs and is divided into the quads QDsO-QDs3. The quad QDsO 
10 is written in the quad QDtl of the target stamp STPt. 

Subsequently, the stamp STP12 will be the source stamp 
and is divided into the quads QDsO-QDs3. The quad QDs2 is 
written in the quad QDt2 of the target stamp STPt. 

Subsequently, the stamp STP13 will be the source stamp 
15 and is divided into the quads QDsO-QDs3 . The quad QDs2 is 
written in the quad QDt3 of the target stamp STPt. 

The quads not written in the target stamp STPt are all 
discarded. 

In this state, all quads in the target stamp STPt are 
2 0 valid so that the target stamp STPt is output as a merged 
stamp STPm, and the target stamp is initialized. 

Quads QDmO-QDm3 included in the merged stamp STPm 
maintain their quad addresses ADDqd in the originating stamps 
STP10 -STP13 along with the stamp addresses ADDstp of the 
25 originating stamps STP10 - STP13 . 

Fig. 14 shows how the quads QDmO-QDm3 are distributed 
to the output units 46a-46d in the area writer 40. The 
memory access unit 44 of the area discarder 3 0 outputs the 
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four quads QDmO -QDm3 within the merged stamp STPm in the 
stated order at times Tl , T2 , T3 and T4 , respectively. At 
time Tl, the quad. QDmO is decomposed into pixels, which are 
simultaneously output in parallel. 
5 Subsequently, the quads QDml-QDm3 are decomposed into 

pixels and are sequentially output at times T2 , T3 and T4 , 
respectively . 

Figs. 15A-15C show how the area writer 40 writes the 
merged stamp STPm of Fig. 13 into the cache memory 50. 

10 As shown in Fig. 15A, the area writer 40 refers to the 

stamp address ADDstp in addition to the quad address ADDqd , 
in writing the quads QDm. For example, the quad QDmO input 
at time Tl has a stamp address of 0001 and a quad address of 
00, the quad QDmO is written in an associated address in the 

15 cache memory 50. A similar thing is true of the quads QDml- 
QDm3 . 

As a result, as shown in Fig. 12C, the final stamps 
STPfl and STPf2 in which the stamps STP10 - STP13 of Fig. 10 
are merged are written into the cache memory 50. The final 
20 stamp STPfl is a result of merging the stamps STP10 and STP11. 
The final stamp STPf2 is a result of merging the stamps STP12 
and STP13 . The final stamps STPfl and STPf2 are written in 
positions with the stamp addresses ADDstp of 0001 and 0010. 

By performing expanded merge according to the 
25 embodiment in which stamps having different addresses are 

temporarily merged, the number of times that the area writer 
40 accesses the cache memory 50 can be reduced. 

According to expanded merge, merge can be performed 
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even if stamp addresses differ. Therefore, the number of 
valid quads within a merged stamp can be increased and 
efficiency in image processing can be improved. 

The embodiment described is only illustrative in nature 
5 and various variations in constituting elements and processes 
involved are possible. Those skilled in the art would 
readily appreciate that such variations are also within the 
scope of the present invention. 

In the described embodiments, a stamp comprising 4x4 

10 pixels forms a pixel group, and a quad comprising 2x2 pixels 
forms a small pixel group. Other configurations are also 
possible. For example, an array of 1x4 pixels may form a 
small pixel group, or an array of 4x1 pixels may form a quad. 
The number of pixels included in a quad is preferably, 

15 but not necessarily, equal to the number of pixels 

simultaneously written in the cache memory 50 in parallel. 
The number of pixels included in a quad may be two, in a 
configuration in which four pixels are simultaneously written 
in the cache memory 50 in parallel. The size of a stamp and 

20 the size of a quad may appropriately be determined by 
considering the hardware cost and the cost required in 
implementing the process. 

While the preferred embodiments of the present 
invention have been described using specific terms, such 

25 description is for illustrative purposes only, and it is to 

be understood that changes and variations may be made without 
departing from the spirit or scope of the appended claims. 



